Order selection and sparsity in latent variable models via the ordered factor LASSO
نویسندگان
چکیده
منابع مشابه
Variable selection via the grouped weighted lasso for factor analysis models
The L1 regularization such as the lasso has been widely used in regression analysis since it tends to produce some coefficients that are exactly zero, which leads to variable selection. We consider the problem of variable selection for factor analysis models via the L1 regularization procedure. In order to select variables each of which is controlled by multiple parameters, we treat parameters ...
متن کاملSparsity and smoothness via the fused lasso
The lasso penalizes a least squares regression by the sum of the absolute values (L1-norm) of the coefficients. The form of this penalty encourages sparse solutions (with many coefficients equal to 0).We propose the ‘fused lasso’, a generalization that is designed for problems with features that can be ordered in some meaningful way. The fused lasso penalizes the L1-norm of both the coefficient...
متن کاملPosterior vs Parameter Sparsity in Latent Variable Models
We address the problem of learning structured unsupervised models with moment sparsity typical in many natural language induction tasks. For example, in unsupervised part-of-speech (POS) induction using hidden Markov models, we introduce a bias for words to be labeled by a small number of tags. In order to express this bias of posterior sparsity as opposed to parametric sparsity, we extend the ...
متن کاملVariable selection in monotone single-index models via the adaptive LASSO.
We consider the problem of variable selection for monotone single-index models. A single-index model assumes that the expectation of the outcome is an unknown function of a linear combination of covariates. Assuming monotonicity of the unknown function is often reasonable and allows for more straightforward inference. We present an adaptive LASSO penalized least squares approach to estimating t...
متن کاملRegularization of Latent Variable Models to Obtain Sparsity
We present a pseudo-observed variable based regularization technique for latent variable mixed-membership models that provides a mechanism to impose preferences on the characteristics of aggregate functions of latent and observed variables. The regularization framework is used to regularize topic models, which are latent variable mixed membership models for language modeling. In many domains, d...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Biometrics
سال: 2018
ISSN: 0006-341X,1541-0420
DOI: 10.1111/biom.12888